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DETAILED ACTION 
Response to Amendment 

1 . Applicant's amendment filed on July 15, 2004 has been entered and made of 
record. 

Applicant's arguments with respect to claims 1-6,15-18, 41 and 42 have been 
considered but are moot in view of the new ground(s) of rejection. 

Drawings 

2. Drawings filed on 7/15/04 have been approved by the Examiner. 

Claim Rejections - 35 USC §112 

3. The following is a quotation of the first paragraph of 35 U.S.C. 112: 

The specification shall contain a written description of the invention, and of the manner and process of 
making and using it, in such full, clear, concise, and exact terms as to enable any person skilled in the 
art to which it pertains, or with which it is most nearly connected, to make and use the same and shall 
set forth the best mode contemplated by the inventor of carrying out his invention. 

Claims 1, 10, 15, 41 and 42 are rejected under 35 U.S.C. 112, first paragraph, as 
failing to comply with the written description requirement. The claim(s) contains subject 
matter, which was not described in the specification in such a way as to reasonably 
convey to one skilled in the relevant art that the inventor(s), at the time the application 
was filed, had possession of the claimed invention. 

The original disclosure fails to provide support for the "-- without fidicual mark --" 
in claim 1, line 9. Claims 10, 15, 41 and 42 recite the similar limitations. The applicant 
indicates that paragraph 0032 discloses the above limitation, but examiner could not 
find this phrase in that paragraph. 
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Claim Rejections - 35 U.S.C. § 102 

4. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless -- 

(e) the invention was described in (1 ) an application for patent, published under 
section 122(b), by another filed in the United States before the invention by the 
applicant for patent or (2) a patent granted on an application for patent by another filed 
in the United States before the invention by the applicant for patent, except that an 
international application filed under the treaty defined in section 351(a) shall have the 
effects for purposes of this subsection of an application filed in the United States only if 
the international application designated the United States and was published under 
Article 21(2) of such treaty in the English language. 

Claims 1-6, 15,16, 41 and 42 are rejected under 35 U.S.C. 102(e) as being 
anticipated by Sundareswaran et al. (US. 6,330,356 B1). 

As to claim 1, Sundareswaran discloses a method for accurately estimating a 
pose of a camera (fig 1 , 20) within a scene using a three-dimension model of the scene 
(fig 1 , 30, column 6, lines 7-14, 19- 24), comprising the steps of: 

(a) generating an initial estimate of the pose (column 6, lines 19-42); 

(b) selecting a set of relevant features (ring shaped marker corresponds to 
features, fig 3, 72) of the three dimensional model based on the initial estimate of the 
pose (column 6, lines 37- 48); 
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(c) creating a virtual projection (column 4, lines 12- 21) of the set of relevant 
features responsive to the initial estimate of the pose (column 6, lines 48- 58, column 7, 
lines 2-58); 

(d) matching a plurality of features of an image received from the camera to the 
virtual projection of the set of relevant features, without using fiducial markers and 
measuring a plurality of matching errors (computing a disparity between the positions 
of the features and 

corresponding positions of features in a calculated projection of a stored, 
three-dimensional object model CAD, and calculated projection based on a virtual 
camera model, column 8, lines 56- 67, column 9, linel to column 10, lines 1- 56); and 

(e) updating (based on the position and orientation parameters of the virtual 
camera are identified by rotating and shifting the virtual camera point of view, column 
1 1 , lines 2-7) the estimate of the pose to reduce the plurality of matching errors (fig 1 
and 7, column 6, lines 60- 67, column 8, lines 56-67, column 9, line 1 to column 10, 
lines 1-56). 

As to claim 15, see the rejection of claim 1 . 
As to claim 41 , see the rejection of claim 1 . 

As per claim 42, claim 42 recites similar limitation as claim 1 above and similarly 
analyzed. Sundareswaran teaches the step of (f) point of view refinement means for 
updating the estimate of the point of view to reduce the plurality of matching errors 
(column 8, line 56- 67, column 9, lines 1-45, column 10, lines 52- 56); and 
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(g) model refinement means, responsive to the estimated point of view and to the 
image, for updating the three-dimensional model as taught by Sundareswaran (column 
8, line 56- 67, column 9, lines 1-45, column 10, lines 52- 56). 

As to claim 2, Sundareswaran discloses the method further comprising the step 

of: 

(f) repeating to steps (c), (d), and (e) using the updated estimate of the pose until 
the plurality of matching errors are less than predetermined matching criteria (fig 1 and 
7, column 6, lines 60- 67, column 8, lines 56-67, column 9, line 1 to column 10, lines 1- 
56). 

As to claim 3, Sundareswaran discloses the method further comprising the steps 

of: 

(f) adding the updates to the estimate of the pose made in step (e) to a total 
change value of the estimate of the pose (fig 1 and 7, column 6, lines 60- 67, column 8, 
lines 56-67, column 9, line 1 to column 10, lines 1-56). 

(g) if the total change value is less than predetermined (column 7, lines 32- 35, 
column 9, lines 7-38) pose change criteria (column 4, lines 12- 21), resetting the total 
change value and repeating to steps (b), (c), (d), (e) and (f) using the updated estimate 
of the pose (column 6, lines 60- 67, column 1 1 , lines 2-7); and 

(h) repeating to steps (c), (d), (e), (f) and (g) using the updated estimate of the 
pose until the plurality of matching errors to are less than predetermined matching 
criteria (fig 1 and 7, column 6, lines 60- 67, column 8, lines 56-67, column 9, line 1 to 
column 10, lines 1-56). 
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As to claim 4, Sundareswaran discloses the method wherein step (a) includes 
the step of comparing an image received from the camera to the three-dimensional 
model of the scene to generate the estimate of the pose (column 1 1 , lines 1 7-58). 

As to claim 5, Sundareswaran discloses the method wherein step (a) includes 
the step of using a preceding pose estimate of a preceding image received from the 
camera to generate the estimate of the pose (column^, lines 60- 67, column 8, lines 56- 
67). 

As to claim 6, Sundareswaran discloses the method wherein step (b) includes 
the steps of: 

b1) Z-buffering the three dimensional model based on the estimated pose to 
determine a set of visible features of the three dimensional model (column 4, lines 13- 
36, column 11, lines 17-67, column 12, lines 1-5); and 

(b2) selecting the set of relevant features from the set of visible features (column 

4, lines 13-36). 

As to claim 16, Sundareswaran discloses the method wherein step (b) includes 
the step of: 

(bl) projecting a plurality of color values of the image onto the three dimension 
model of the scene to update a texture of a surface of the three dimensional model 
(column 6, lines 19- 25). 

Claim Rejections - 35 t/.S.C. § 102 

5. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 
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A person shall be entitled to a patent unless 

(b) the invention was patented or described in a printed publication in this or a foreign country or in 
public use or on sale in this country, more than one year prior to the date of application for patent in 
the United States. 

Claims 17 and 18 are rejected under 35 U.S.C. 102(b) as being anticipated by 
Cox et al. (US. 5,644,651). 

As to claim 17, Cox discloses a method for accurately estimating a position of 
remote vehicle using (column 6, lines 21-31) a three-dimension model and an image 
from a camera having a known orientation relative to the remote vehicle (column 1 , lines 
62- 67, column 2, lines 1-31), comprising the steps of: 

(a) comparing the image to the three dimension (column 1 , lines 8-12) model of 
the scene to generate an estimate of the pose (column 2, lines 24-53, column 4, lines 
53-60); 

(b) selecting a set of relevant features (epipolar lines are considered to be a set 
of features, column 3, lines 8-22) of the three dimensional model based on the estimate 
of the pose (column 5, lines 7- 42); 

(c) matching (column 4, lines 12-67) a plurality of features of the image to the set 
of relevant features and measuring a plurality of matching errors (column 5, lines 7- 42); 

(d) updating the estimate of the pose based on the plurality of matching errors 
(column 5, lines 1-67, column 6, lines 1-31); and 

(e) determining the position of the remote vehicle based on the estimate of the 
pose and the orientation of the camera (column 6, lines 21-31). 
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As to claim 18, Cox discloses the method of claim 17, further comprising the step 

of: 

(f) updating the three dimensional model based on data from the image and the 
updated estimate of the pose (column 5, lines 1-67, column 6, lines 1-31). 

Allowable Subject Matter 
6. Claims 7-11,1 9-26, are allowed. 
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Other prior art cited 

7. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

Anandan et al. (US.6,192,145B1) discloses method and apparatus for three- 
dimensional scene processing using parallax geometry of pairs of points. 

Kumar et al. (US.6,522,787B1) discloses method and system for rendering and 
combining images to form a synthesized view of a scene containing image information 
from a second image. 

Imaizumi et al.(US. 6,047,087) discloses image processor. 

Martin et al. (US. 5,850,469) discloses real time tracking of camera pose. 
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Contact Information 

8. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Sheela C Chawan whose telephone number is 703- 
305- 4876. The examiner can normally be reached on Monday - Thursday 6-7. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Bhavesh Mehta can be reached on 703-308-5246. The fax phone number 
for the organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 



Sheela Chawan 
Patent Examiner 
Group Art Unit 2625 
November12, 2004 



